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Abstract 

The lift-and-project closure is the relaxation obtained by computing all 
lift-and-project cuts from the initial formulation of a mixed integer linear pro- 
gram or equivalently by computing all mixed integer Gomory cuts read from 
all tableau's corresponding to feasible and infeasible bases. In this paper, we 
present an algorithm for approximating the value of the lift-and-project clo- 
sure. The originality of our method is that it is based on a very simple cut 
generation linear programming problem which is obtained from the original 
linear relaxation by simply modifying the bounds on the variables and con- 
straints. This separation LP can also be seen as the dual of the cut generation 
LP used in disjunctive programming procedures with a particular normaliza- 
tion. We study some properties of this separation LP in particular relating it 
to the equivalence between lift-and-project cuts and Gomory cuts shown by 
Balas and Perregaard. Finally, we present some computational experiments 
and comparisons with recent related works. 



1 Introduction 

In this paper, we consider Mixed Integer Linear Programs (MILP) of the form: 

lT 

max c x 
s.t. 

A'x > b, 

x G 1F + x R n + - p , 



(MILP) 
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where A' is an m x n rational matrix, d G Q n and b G Q m . 

In the last 20 years, cutting plane methods have become one of the main ingre- 
dients for solving MILP. State of the art solvers are branch- and- cut algorithms that 
employ a number of different cutting plane algorithms to automatically strengthen 
formulations: Gomory Mixed Integer (GMI) Cuts [31], Mixed Integer Rounding cuts 
[38] , Knapsack Covers [14] , Flow-covers [391 SO] • The positive impact of these dif- 
ferent methods on the solution algorithms for MILP have been evaluated in many 
independent computational studies for example [IB] . 

A central concept in cutting planes for MILP is that of elementary closures. Sim- 
ply put, the elementary closure of a given family of cuts is the relaxation obtained by 
applying all cuts of the said family that can be obtained using the initial formulation 
of MILP only (without a recursive application). Two well known closures are the 
Chvatal-Gomory closure [21] obtained by applying all possible Gomory Fractional 
cuts [33] and the split closure [22J. Elementary closure have been a fruitful concept 
from a theoretical standpoint. In particular, four important results are the facts that 
the Chvatal-Gomory closure is a polyhedron [21] on which it is NP-hard to optimize 
[27] and that the split closure is also a polyhedron [22J on which it is NP-Hard to op- 
timize [20] • More recently, closures have also been considered from a computational 
point of view. Several authors have computed empirically the strength of different 
closures on problem instances from the literature: Fischetti and Lodi have computed 
the Chvatal-Gomory closure [28], Bonami and Minoux the lift-and-project closure 
[19] . Bonami et. al. the projected Chvatal-Gomory closure [18] . Balas and Saxena 
the split closure [13] and Dash, Giinluk and Lodi the MIR closure [26]. These studies 
have shown that elementary closure often give rise to strong relaxation of MILPs. 
In particular, the Split and MIR closures, which are equivalent, often close a very 
significant portion of the integrity gap, even though computing time are prohibitive. 
In that view an interesting line of research is to devise faster algorithms that could 
give a fairly good approximation of the split closures. 

In this paper, we are interested in approximating the split closure by looking at 
simpler (and weaker) closures that are defined by two families of cuts: GMI cuts 
read from LP tableau's and strengthened lift-and-project cuts [7J. It was shown by 
Balas and Perregaard [12J that both classes of cuts are equivalent and define the 
same closure which we call lift-and-project closure. The lift-and-project closure is 
a polyhedron but, to the best of our knowledge, it is not known whether it can be 
optimized in polynomial time. A weaker closure that can be optimized in polyno- 
mial time is the elementary lift-and-project closure on which one can separate in 
polynomial time by using disjunctive programming. Our goal in this paper is to 
devise efficient algorithms to compute the elementary lift-and-project closure and to 
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approximate heuristically the lift-and-project closure. 

Our approach is similar to the one proposed in [19]: we optimize the elementary 
lift-and-project closure by a cutting plane algorithm and strengthen each cut indi- 
vidually to approximate the lift-and-project closure. Our main contribution with 
respect to [19] is that we use a different cut generation oracle. While in [19J a linear 
program in an extended space is solved to generate each cut, here we solve a linear 
program in the original space of variables which we call membership LP. Further- 
more, we are able to establish some nice properties of this membership LP, and show 
that it is typically solved in very few iterations. 

Our work is related to [12] . First the membership LP is related to disjunctive 
programming and the classical Cut Generation LP (CGLP). It can be seen as the 
dual of a simplified version of the CGLP used in [T2] . The simplicity of its structure 
allows us to give a new view on the equivalence between strengthened lift-and-project 
cuts and GMI cuts that was shown in [12]. It also gives further insights into this 
equivalence. In particular a separation algorithm was proposed in [12J to separate 
lift-and-project cuts in the LP tableau of the linear relaxation. One limitation of 
the algorithm is that it only works by improving an existing cut, our separation 
procedure removes this limitation. 

Our work is also related to several recent computational studies. Dash and Goy- 
coolea [25] and Fischetti and Salvagnin [31] proposed two different methods for sep- 
arating rank-1 GMI cuts from alternate bases of the LP relaxation. Our work can 
be seen as a third proposal for finding rank-1 GMI cuts. We also note that the same 
separation LP that we use, was independently used in a recent work by Fischetti and 
Salvagnin [30] to also optimize on the simple lift-and-project closure. 

In Section 2, we give formal definitions of the various cutting planes and closures 
we are interested in. In section 3, we introduce the membership LP and establish its 
relations to disjunctive programming. In Section 4, we establish various properties 
of the solutions of the membership LP and relate it to GMI cuts. In Section 5, we 
discuss the practical solution of the membership LP and its use for optimizing the 
lift-and-project closure. Finally, in Section 6, we present computational results. 
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2 Definitions and basic results 



The Linear Programming (LP) relaxation of (MILP) obtained by dropping all in- 
tegrity constraints is 



max c x 



t > h (LP) 
A x > o, 



x e Ml. 



We also consider the standard form of fILPj) where slack variables are introduced: 



max c T x 



Ax = 6, ^ 



In (ISLPj) . we assume that the slack variables are the first m ones (xi, . . . , x m ) and 



the structural variables are the last n (x m+1 , . . . ,x m+n ). With this ordering of the 
variables A = (—1 A') (where I is the identity matrix) and c T = (0 T , c /T ). We 
denote by N := {m + 1, . . . , m + n} the index set of structural variables in (1SLPI) . by 
N 1 := {m + 1, . . . , m + p} the index set of integer constrained structural variables 
and by M := {1, . . . , m} the set of slack variables (or the set of constraints). Given 
a set J C M U N, we denote by xj the vector with component in J and by A J the 
sub- matrix of A composed by the columns % G J {A' = A N ). Given J C M, we 
denote by Aj the sub-matrix of A composed by the rows of A indexed by J. By 
abuse of notations we will denote A^ and Au\ by A^ and Ai respectively 

We denote the index set of variables in a basis of LP by B := . . . ,i m } C 
{1, . . . , n + m} and the index set of nonbasic variables by J := {1, . . . , n + m} \ B. 
Given the index set of a basis B; A B is the basis matrix (we recall that variables in- 
dexed by B form a basis whenever A B is non-singular), the LP tableau corresponding 
to B is given by 

x B = A B ^b- A B ^A J xj. 

Finally, we denote A = A B 1 A and b = A B l b. 

Next, we define the four cutting planes used in this paper: simple intersection 
cut, GMI cut, lift-and-project cut and strengthened lift-and-project cut. 
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2.1 Cutting planes 



Before proceeding to the definitions of the various cutting planes, we briefly remind 
the concepts of disjunctive and split cuts that are central to the four methods. 

In MILP, we call disjunction a condition of the form A 1 x > b 1 V A 2 x > b 2 V . . . V 
A q x > b q that is satisfied by all solutions to ( VMILPI) (i.e. each solution of ( IMILPI) 
verifies at least one of the systems of inequalities). For example, if (tt, ttq) G Z ra+1 is 
such that 7T{ P+1 n } = the split disjunction ir T x < ttq V % T x > ttq + 1 is valid for 
(IMILPj) . All inequalities presented here, result from split disjunctive in that, for a 
given (tt, tt ) they are valid inequalities for the set: 

pfr,ir ) .- CQnv (| x G R " . A ' x > &> n T x < ^ j u | x G R n . £ % > ^ x > ^ + l}) . 

As such, all the inequalities presented belong to the family of split cuts[22\. 

The simple intersection cut Let B be a basis of (ISLPj) and ik E BD N 1 be such 
that bk ^ Z. The row of the simplex tableau corresponding to i^ is 



Let fo = bk— [bk\ ■ The intersection cut [3] from the convex set {x G R n+m : \pk\ < 
Xi k < \h] } applied to §Q is 



This cut is valid for all solution to ( IMILPj) and is also known as the simple disjunctive 
cut from the condition Xi k < \bk\ V x ik > \bk] ■ 

Gomory Mixed Integer Cut The simple intersection cut can be strengthened 
using the integrity of the variables in J n N 1 . For each j G J PI N 1 we define 
fj := a k j — [a k j\ ■ We define tt G Z m+n as 




(1) 



^max{a fej (l - / ), -a kj f }xj > / (1 - / ) 

J'GJ 



(2) 




if jG JHN 1 and/, < Jo 
if j G J n N 1 and fj > f 

if j = ik, 
otherwise. 
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The Gomory Mixed-Integer Cut is the intersection cut from the convex set {x G 
R n+m : [b k \ < ir T x < \b k ]} applied to ©: 

^2 fj( 1 ~fo) x j+ ^2 ( 1 ~fj)fo x J+ max {akj(l ~ fa), -a kj f }xj > / (l-/o) 

jeJnN 1 jeJrw 7 jeJVV 7 

fj<fo fj>fo 

(3) 

We note that the GMI cut dominates all intersection cuts obtained from row flTJ 
and convex sets of the form {x G i? n+m : [& fc J < tt t x < |7> fc ] } with 7iv n Ni)u(B\u k }) — 
and 7T ife = 1 (see [I] for a proof). 

The lift-and-project cut The lift-and-project cuts are the valid inequalities for 
the sets p( ek ' 7T °'> taken for any k = 1, . . . ,p and ttq G Z, obtained by intersecting the 
polyhedron {x G : A'x > 6} with a simple disjunction of the form x k < vr V > 

TTo + 1. 

The fundamental theorem of Balas [SJ H] on unions of polyhedra allows to formu- 
late the separation problem for P^^o) as a linear program. 

Theorem 1 (j5J E]). Let x G x G P^ ) i/ and only if the solution to the Cut 
Generation LP 

min a T x — (3 
s.t. : 

a = u T A N + s — u 7i, 
a = v T A N + t + v ir, 
f3 = u T b — u ir , 

P = V T b + V (7T + l), 

a G R n ,(3 G R, u,v G R™, s, t G M+, u ,v G E + , 

is non-negative. 

If the solution the cut generation linear program is negative, a T x > (5 defines a 
valid inequality in the space of structural variables that cuts off the point x. 

Lift-and-project cuts are separated by solving the cut generation linear program 
for simple disjunctive (i.e. with n = e k )- Since this program is unbounded whenever 
it has a negative solution, a normalization constraint is often added to cut the cone of 
feasible solution. Following [TTJ, the most commonly used constraint is ^2 ieM (ui + 
v i) + Siejv( s * + U) + uo + vo = 1. In the remainder, we denote by (CGLP) the 
cut generation linear program of Theorem [1] augmented with that normalization 
condition. 
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The strengthened lift-and-project cut Lift-and-project cuts can be strength- 
ened in a similar fashion as simple intersection cuts can be strengthened to GMI 
cuts. 

Consider a basic solution (a, j3, u, v, s, t, u Q , v ) to (CGLP), the coefficients a ver- 

ify: 

o.k = max{uA h — u 0l vA k + v } 

and 

&j = max{-uA' J , vA J }, j ^ k 

These coefficients can be strengthened by replacing ctj, for j G {1, . . . ,p} \ {k}, 
with 

a.j := minj-uA- 7 — ii \rrij\ , vA^ + v [m 3 -] } 

where 

uA> - vA J 

mj := — ; — , 

u + v 

(see [TQl E] for justifications.) 



2.2 Equivalences and Closures 

Balas and Perregaard showed that simple intersection cuts are equivalent to lift-and- 
project cuts, and that GMI cuts are equivalent to strengthened lift-and-project cuts 
|12j . The equivalence can be stated as follows: every simple intersection cut (resp. 
GMI cut) from a basic solution (feasible or not) of (ISLPI) can be derived as a lift-and- 
project cut (resp. strengthened lift-and-project cut) obtained from a basic feasible 
solution of (CGLP); and conversely every lift-and-project cut from a basic feasible 
solution of (CGLP) is an intersection cut. Here similar means that after the two cuts 
are put into the same space by eliminating slack variables they are identical up to 
multiplication by a positive scalar. The equivalence gives the precise correspondence 
between the two bases of (ISLPI) and (CGLP). In view of this result, solving (CGLP) 
can be interpreted as finding a good basis from which to generate a GMI cut. 

We note that this result is stated in [12] for 0-1 MILP only but its generalization 
to MILP is straightforward. 

Generally speaking, the elementary closure of a family of cuts consists of all cuts 
in the family that can be obtained directly from the initial formulation. A direct 
consequence of the result mentioned above is that lift-and-project cuts and simple 
intersection cuts on one hand and GMI cuts and strengthened lift-and-project cuts 
on the other hand are equivalent in terms of their closures [23] . 
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The simple lift-and-project closure is obtained by taking all cuts defined by basic 
feasible solutions to (CGLP). We denote it by P e . Geometrically, It is obtained by 
intersecting all polyhedra P^' 71 " ) for all k G {1, . . . ,p} and all 7Tq G Z: 



P e := p| P^ 



no) 



ke{i,...,p} 



Equivalently, P e is obtained by taking all simple intersection cuts from all bases 
(feasible and infeasible) of (ISLPj) . We denote by B the set of all bases of (1SLPI) . 
For each B G B, we define P{B) the cone obtained by dropping the non-negativity 
requirements of the variables j G" B: 

P(B) := {x G M. n+m :x B = b- A J xj, xj > 0}. 
The simple lift-and-project closure can be defined alternatively as 

P e = W o] N ( P| p| conv (P (B) f]{xe R n+m : x m+k < [b k \ V x m+k < \b k ] }) 
XBeBkeN'nB 

(where projTv denotes the projection onto the space of structural variables). 

The lift-and-project closure is defined by taking all strengthened lift-and-project 
cuts obtained from all basic feasible solutions to (CGLP). We denote it by P e *. It 
is more difficult to give a precise and intuitive geometrical definition of it than for 
P e . By using the equivalence between lift-and-project cuts and GMI cuts, P e * is also 
obtained by taking all GMI cuts defined from all bases of fISLPp . More formally, for 
each basis B G B and k G N 1 fl B, let LTf := {(ir, 7r ) G Z n+1 : 7T& = 1, TTNXN'uB^k} — 
0, 7r = \bk\}- be the subset of splits that are considered for strengthening the 
simple intersection cut from basis B and variable k (i.e. all valid splits which have 
zero coefficients for all basic variables except one). The lift-and-project closure is the 
intersection of all strengthened intersections cut obtained from these larger subset of 
splits: 

:= p^ j pi n n c ° nv ( p ^ n & e Rn+m : nTx - n ° v nTx - *° + *}) 

\BeB keN'nB (7r,7r )enf 

Since both P e and P e * are defined by a finite number of inequalities both are 
clearly polyhedra. Moreover, P e can be optimized in polynomial time. To the best 
of our knowledge, it is not known if P e » can be optimized in polynomial time. 
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Finally, let us remind that the split closure Ps is obtained by intersecting all split 



cuts: 



n 



p(l~,7>"0) 



(7T,7r )eZ™XZ 



T {p+l,...,n} 



=0 



As shown by [22], Ps is a polyhedron. Andersen, Cornuejols and Li (2] have shown 
that Ps can also be defined in terms of intersection cuts: 



/ 



P< 



s = Projw 



\ 



p| p| conv (P (B) n{xe R n+m : n T x < tt V n T x > tt + l}) 



. BeB 0r,7ro)ez™xZ 

\ 7r {p+l,...,n}=0 



/ 



From the definitions, it should be clear that Ps C P e * C P e » , since P e * and P e only 
use a subset of splits and elementary disjunctions belong to Ilf . It is NP-Hard to 
optimize over Ps- Computational studies such as [T3l [26] have shown that it can 
be a strong relaxation, but computational times are often prohibitive (in the two 
studies computing Ps often takes more time than solving [MILPI to optimality). This 
justifies our motivation to optimize P e . and P e . 



3 The membership LP 

In this section, we establish a linear program which given a split disjunction (tt, 7Yq) 
and a point x G M n answers the question of whether x G p( 7r > 7r °). It should appear 
immediately that this question can already be answered by solving (CGLP) using 
Theorem HJ Our linear program is indeed similar to (CGLP), by duality, but it 
does not require the introduction of new variables and is formulated in the same 
space as (ILPI) . We will mostly use the results of this section in the context of simple 
disjunctive (i.e. when % = e*), but since they are not restricted to simple disjunctive, 
we present them in the more general context of split disjunctive. 
Our membership LP is based on the following proposition. 

Proposition 2. Let P = {x E R™ : A'x > b}, x e P and (tt , tt) G Z n+1 be such that 
7r < 7r T x < 7To + 1. x G conv (P D ({n T x < 7r } U {n T x > ir + l})) if and only if 
there exists y G M n such that 

TT T y - (tt + 1) (jrx - tt ) > 

< A'y - b (nx - tt ) <A'x-b (4) 
< y < x 
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This proposition can be proved in different ways. In particular, it is closely related 
to classical results of disjunctive programming. We will discuss in the following 
paragraphs the connections between (jlj) and (CGLP). First, we give a short and self 
contained proof of it since it provides a simple way to understand (jlj). 

Proof. (i) Suppose that x E P^ ^. Since n T x — n e]0, 1[, there exists x° E 
Pr\{7i T x < 7T }, x 1 E Pf]{n T x > tt + 1} and A e]0, 1[ such that x = Xx 1 + (1- 
X)x°. Without loss of generality, we can assume that n T x° = n , n T x l = 7r + l. 
Then, since ^(Xx 1 + (1 — X)x°) = n T x, we have 

A = n T x — n . 

We take y = Xx 1 and verify that it satisfies (jlj). 

First, 7r T y-(7ro + l)(7r T £-7r ) = A(tt + 1) - (tt + 1)A = 0. Also, Ay-b(n T x- 
7T ) = (Ax 1 - b) X > and y = Xx 1 > 0, since Ax 1 > b , x 1 > and A > 0. 
Furthermore, since x = y + (1 — X)x° we have: 

Ay - Xb + (1 - X){Ax° -b) = Ax-b. 

and therefore, since Ax° — b > and A < 1 

Ay - Xb < Ax - b. 

y < x in the same manner. 

(ii) Suppose now that y satisfies (jlj). Let A = nx — 7r . Note that < A < 1 
by hypothesis. We take x 1 = ? and x° = ■ Clearly x = Xx 1 + (1 — A)x°. 
Furthermore x l E P and ^x 1 > 7Tq + 1. 



It remains to show that x° E Pr\{ii T x < tyq}. x° E P, since (1 — X)(Ax° — b) = 
A(x -y) - b + bX = Ax - b - Ay + bX > and (1 - A)x° = x - y > 0. Finally 

T o K" T £ - 7T T y - (1 - A)?r -ix T y + A + Att n T y - (tt + 1)A 

"~^ = yz~x = — — = r^A — - 

□ 

By applying Proposition j2j we can formulate a linear program which answers the 
question of membership for x and P^ ' 71 "); 

max n T y — (7r + 1) (nx — 7r ) 
s.t.: 

MLP 

< A'y - b (nx - n ) <A'x-b, 
< y < x. 
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As a direct application of the proposition, x G p( n o,n) jf anc [ on iy if the optimal 
solution to flMLPl) is non- negative. 

An alternative way to prove the theorem is to see that (IMLPI) is closely related 
to the dual of (CGLP) with the normalization condition u + Vq = 1: 

min a T x — f3 
s.t.: 

a = u T A' + s — u n, 

* = v T A> + t + v *, (CGLp>) 

(3 = u b — 7f u , 

= v T b + (vr + l)v , 

u + v = 1, 

ii,d6 R™, s, t G R", M Q , f e M+ 

A basic results stated in [12] (Lemma 1) is that in any solution of (CGLP) that yields 
an inequality a T x > f3 that is not dominated by the constraint of (ILPj) . both uq and 
are positive. The following lemma shows that in fact, if we assume x G P and 
7r < n T x < 7r + 1, the conditions u ,v Q > can be dropped from (ICGLP'I) . 

Lemma 3. Let x G P be such that n < n T x < 7r + l. Suppose that (a, (3, u, v, u , v ) 
verifies the following system of equations: 

a = u T A' + s — uqtx, 
a = v T A' + t + v n, 

{3 = U T b — 7To«o, 

p = v T 6 + (7r + l)«o, 
u + v = 1, 

u,ve R™, s, t G M™, M ,^o e R 
< or vq < 0. T/ien a T a; > /3. 

Proof. The proof if similar for Uq < and t>o < 0; we only consider the case Uq < 0. 

Let (a, /3, it, u , «o, vq) be a vector that satisfies the conditions of the statement. 
Then, by definition of (a, (3, u, v, uq, vq) 

a T x — (3 — (u T A' + s — Uq7t)x — u T b + tt Uq = u T (A'x — b) — u (tt t x — n ). 

Now the last quantity is non-negative since u > 0, A'x — b, tc t x > n and Uq < 0. □ 
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Since we are only interested in negative solutions to (ICGLP'j) . by application of 
the lemma, we can therefore remove the conditions uq,vq > 0. 

After removing non- negativity constraints on uq and vq, we can eliminate a, (3 
and v from (jCGLP'p : 



mm(u T A')x + (s — Uq1x) t x — u T b — n Uo, 
s.t.: 

(u - v) T A' + (s - t) = 7T 

(V — U) T b — U = — 7T — 1 

u,ve R+, s, t G R™, M G R 

Finally we eliminate Uq\ 

mmu T (Ax — b) + s T x + (ir T x — n ) ((u — v) T b — 7r — l) , 
s.t.: 

(u - v) T A + (s-t) = 71 
u,D6 R+, s, t G 



/, . (5) 



Taking the dual, with multipliers y associated to the constraints, one obtains (IMLPj) . 



It should be clear from this development that a dual feasible solution to ( IMLPj) with 
negative dual cost gives rise to a valid cut for p( 7r ' 7r o). 

Remark 4. Note that one should be careful when dropping the non-negativity con- 
ditions on u and Vq in (ICGLP'j) . This has indeed one important consequence: 



while non-negative solutions to ( ICGLP'j) define valid (non-violated) inequalities, non- 
negative solution to (jHJ) do not. For example, the trivial solution u = v = 0,s — t = 7i 
is always feasible for (j5J) but the inequality it defines is not necessarily valid. For 
example take tt = and tt q = 1, the solution u = v = 0,t = 0,s = ek defines the in- 
equality Xk < 2 which certainly can not be valid for all integer programs! Nevertheless 
if the solution is negative, it gives a valid cut. 

(jCGLP'j) (with that normalization condition) has been studied previously in [3 
[TT| [29] . A well known property of the normalization condition uq + Vq = 1 is that 
if x is an extreme point of P such that < Xk — 7r < 1 then an optimal solution 
to (jCGLP'j) with 7r = Ck is the intersection cut obtained from a basis defining x and 
the corresponding strengthened cut is the GMI cut from the same basis (see [21] 
for a precise statement and a complete proof). In the next proposition, we re-state 
the property in the context of (IMLPp . Looking at ( IMLPj) . we are able to give a 
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slightly more precise view: if x is an extreme point, (IMLPj) has a unique solution. 
We present a proof of the results in the context of (IMLPj) since it is short and gives 
insights into the connections between (1LPI) and ( IMLPj) (the fact that the associated 
cut is the intersection cut will follow directly from the results of the next section, we 
delay the proof until then) . 

Proposition 5. Let P = {x G 1R™ : Ax > b}, and x be an extreme point of P such 
that < n T x — 7To < 1, then the unique solution to 

max TC T y — (ttq + l)(nx — ttq) 
s.t: 

< A'y - b(nx - tt ) < A'x - b 
< y < x 

is y = x(n T x — 7r ). Furthermore n T y — (tt + 1)(ttx — n ) < 0. 

Proof. First, we prove that y is a solution. Since < 7TX — 7i"o < 1, and Ax — b > 0: 

< (nx - n )(Ax - b) < Ax - b 
and also < (nx — txq)x < x. 



Second, we show that this solution is unique. We denote by A = x = b = , x = = 0, 
the subset of the inequalities defining P satisfied at equality by x. Since x is an 
extreme point of P, it is the unique solution of A = x = b = , x = = 0. A solution of ([6]) 
satisfies: 

A = y — b = (n T x — 7r ) = 
y= = 0. 

This system in turn has a unique solution. 

Finally, it is trivial to check that n T y — (tc q + 1)(ttx — tt ) < 0: 

T[ T y — ("7r + l)(nx — 7T ) = (nx — ir — l)(nx — 7r ) 

which is the product of a positive and a negative number and therefore always neg- 
ative. □ 

This Lemma has important consequences for the practical usefulness of (IMLPj) . 
In particular, it exposes its main weakness with respect to classical lift-and-project 
cut generation LPs with more general normalization condition such as the one used 
in [TJ. 
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The standard way to apply lift-and-project cuts (and GMI cuts), is to generate 
them recursively by rounds where at each round the current basic optimal solution to 
the LP relaxation (computed by the simplex algorithm) is cut by separating one lift- 
and-project cut for each basic fractional integer constrained variable. At the end of 
the round all the lift-and-project cuts generated are added to the LP relaxation and 
the process is iterated recursively. In such an algorithm, using ( 1MLPI) to generate 
cuts brings little novelty since the point to cut is always an extreme point of the 
polyhedron used to separate and the cuts generated would therefore be GMI cuts 
(and they could certainly be read more quickly from the optimal LP tableau). 

Nevertheless, there are contexts where solving (IMLPj) could present a practical 
interest. In particular one can not always assume that x is an extreme point of P. 
This is the case, for example, if the objective function in (IMILPI) is replaced with 
a nonlinear convex function, or if the LP relaxation is solved with an interior point 
method. In this work, we will focus on another case of interest: generating cuts of 
lowest rank. If in the procedure outlined above, one does not use the previously 
generated cuts to generate new cuts, then the point to cut is not an extreme point 
of the polyhedron used to separate. 



4 Correspondences and equivalences 

Our goal in this section is to relate the cuts that can be obtained from the solution 
of ( 1MLPI) with intersection and GMI cuts. We consider only elementary disjunctions 



of the form x k < 7To V Xk > itq + I. Note that this assumption is not restrictive since 
any split n T x < 7r V n T x > n + 1 can always be put into this form by defining a 
new variable to be equal to n T x. For this elementary disjunction, the membership 
LP is 

max y k - \x k ] (x k - [x k \), 
s.t.: 

< A'y - b(x k - [x k \ )<A'x- b, (MLP' fc ) 
< y < x, 
y e W n . 

For ease of notation, in the sequel, we denote (x k — [x k \) by f k . 



We are interested in dual feasible solutions of (jMLPjJ since they define cuts for 
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our ( 1MILPI) . The dual of flMLP'fc ) is the Cut Generation Linear Program 

mmu T (A'x — b) + s T x + (u — v) T bfk — \x k ~\f k 
s.t.: 

(u - v) T A + (s -t) = e k 
u,v e R?, s, t e Rl. 



(CGLP' fc ) 



A solution (u, v, s, t) to flCGLP'fcQ defines a cut of the form: 

u T A'x + s T x + ((u - v) T b - \xk\) x k > u T b + ((u - v) T b - \xk\ \ [x k \ (7) 

in the space of structural variables. 
Finally, flMLP'fc ) in standard form is 



max y m+k - \x k ] f k 
s.t.: 

Ay = A'x-b + bf k , 
< Vn < x N , 
< Vm < A'x N - b, 
y Gf" + m. 



(SMLP A 



QSMLPjrJ is in the form of a general LP with lower and upper bounds on the variables. 
In a basic solution, we denote by J + the set of variables which are nonbasic at their 
upper bound (corresponding to variables u and s in the dual) and J~ the set of 
variables which are nonbasic at their lower bound (corresponding to variables v and 



t). We recall that a basic solution of QSMLP/J is dual feasible if the reduced costs 
of every variables in J~ is non-positive and the reduced cost of all variables in J + is 
non-negative. 

An immediate property of QSMLPfcD , is that all of its bases are bases of ( 1SLPI) . 



Proposition 6. The variables indexed by B form a base of QSMLPfcl ) if and only if 
they form a base of fISLPj) . 



Proof. Since both problems have the same matrix of constraints this is true by defi- 
nition of bases. □ 

We now turn to the main result of this section which is to characterize the dual 
feasible bases of ( |SMLPfc[ ) and to relate them to intersection cuts for fISLPI) . First, 
in the next lemma, we characterize the dual feasible bases of QSMLPfcl). 
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Lemma 7. Let B = . . . , i m } be the index set of a basis of QSMLPfcP . B is dual 
feasible if either: 

(i) the variable y m +k is non-basic at its upper bound, or 



(ii) i/m+k is basic with corresponding tableau row ym+k+Ylj^j^iiVj = in flSMLPfcD 
and j G J is non-basic at its upper bound if~a~ij < and nonbasic at its lower 
bound ifaij > 0. 

Proof. Let B be a basis, J + be the set of nonbasic variables at their upper bound 
and J~ the set of nonbasic variables at their lower bound. 

First, we prove the case (i). If m+ k B then cb = 0, therefore all variables 
have a zero reduced cost except x m+ k which has a reduced cost of 1 and if m + k is 
nonbasic, it has to be at its upper bound for the solution to be dual feasible. 

Now, we suppose that m + k e B. We assume that x m ^k is basic in row i. The 
reduced cost of a variable j 6 J is given by Cj = Cj — cbA b = — a.y. Therefore, 
B is dual feasible if for all j G J such that > 0, j G J~ and for all j £ J such 
that Qij < 0, j G J + . □ 



Now we study the cuts associated to dual feasible solutions of (IMLPI) . Given a 



dual feasible basis B of (IMLPj) . we will call the cut (JTJ) associated to the solution of 



(CGLP'fc) defined by B, the cut associated to B. Since we use B both as a basis for 



(ISLPI) and (SMLP^J), we need to take particular care in denoting the right-hand-sides 



of the two associated LP tableau's. We will denote by b := A B 1 b, the right hand 



side in the tableau of ( ISLPI) and by ao := A B 1 (A'x — bfk) the right hand side in 



the tableau of (|SMLP fc | ). 



Using the reduced cost computed in Theorem [71 we can compute the values for 
the dual variables. Using these values the cut (JTJ can be computed. Keep in mind 
that by Lemma [3] and remark HI only dual solutions of negative cost give rise to valid 
inequalities. 

Note that in case (i), when y m+ k is non-basic, all dual variables have value 
except Sk which is equal to 1. In that case, the dual objective value of the solution 
is alway non-negative: 

x k - \x k ] (&k - [x k \ ) = L^fcJ ( \x k ] - x k ) > 0, 

and therefore no valid inequality can be generated (note that this case is the one 
exhibited in remark H]) . 

The only case of interest is therefore when y m+ k is basic. In that case, the values 
of the dual variables in the basic solution are given by the reduced costs computed 
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above: 



V 3 
S j 
tj 

In the following, we will denote by x G M n+m the primal basic solution of (ISLPj) 
corresponding to basis B First, we show that the dual solution can have a negative 
cost only if x m+k G ] L^fcJ , \x k ] [. 

Lemma 8. Let B be the index set of a dual feasible basis of QSMLPfcl ) such that 
m + k G B. Let x G ]R n+m be the primal basic solution of (ISLPI) corresponding to 
basis B. Suppose that x m +k ] L^fcJ i \ x k] [, then x is not cut by the dual solution to 
flSMLP/J . 

Proof. By Lemma [3] the dual solution gives a cut for x only if u and v are positive. 
u is given by u = (u-v) T b+ \x m+k \. Note that (u-v) T b = - Y,i&M^ii h = -%m+k- 
Therefore u > only if x m +k < f^m+fel- Similarly since v = 1 — u , v > only if 
x m +k > [x k \ ■ □ 

Lemma [8] indicates that the only relevant dual feasible bases for valid cutting 
planes are those where x~k G ] |_£&J , \xk~\ [■ Next theorem shows that for those dual 
feasible bases, the cut derived is the intersection cut obtained from the row of the 
tableau of fISLPp corresponding to the same basis and the same basic variable. The 
row of the tableau of fISLPp corresponding to x m+ k reads 

Theorem 9. Let B be the index set of a dual feasible basis of QSMLPfcl ) such that 
m + k G B. Let x G ]R n+m be the primal basic solution of (ISLPI) corresponding to 
this basis. Ifx m+ k G ] \_Xk\ , [, the cut obtained from the dual solution of QSMLPfcl ) 
corresponding to the basis indexed by B is equivalent to the simple intersection cut 
for Xk of (ISLPp obtained from the basis indexed by B. 



-a,ij if j G J + n M, 
if j G M \ J+ 

■j if j g J- n M 
if j G M \ J- 

-Oij if j G J+ n N, 
if j G N \ J + 

j ifjeJ-nN 

if j G N \ J~ 



(9) 
(10) 

(11) 
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Proof. We consider the cut (0) defined by the dual solution. To show that ([7]) is 
equivalent to the intersection cut, we first need to write it in the space with slack 
variables. 

u T A'x N + s T x N + ((u - v) T b - \x k ] j x m+k > u T b + ((u - v) T b - \x k ] j [x k \ • 
We start by replacing A'xn — b with 

u T x M + s T x N + ((u - v) T b - \xk] ) x m+k > ((u - v) T b - \x k ] ) [x k \ • 
Using the values of u and s given by ([8]) and ffTUj) this can be rewritten as: 
- ^2 u ii x i + {( u ~v) T b- \x k \j x m+k > ({u -v) T b- \x k \j [x k \ . 

Noting that {u — v) T b = (A B 1 b) i = b~i the cut can be rewritten as: 

- ^ n iJ X J + (Pi - r^fcl) X ™+k > (pi - \x k ]) [X k \. 

Now using the tableau row of fISLPI) x m+k + J2jej®ij x j = we eliminate x m+k : 

~ ®» X i + (P* ~ ^ Xk ^) (P* ~ ?^i X i) - (Pi ~ \ X k\) l X k\- 

Finally, re-grouping the coefficient, we obtain: 

- (pi - [X k \) ^ Uij X j + i\ x k] -k) ^2 - (Pi ~ l X k\){\Xk] - h). (12) 

jeJ+ jeJ- 

Since \ = x m+k G ] [x k \ , \x k ] [, we have \ - \x k \ =\- \ bi\, defining / := 
h — \pi\ = x m +k — [x m+k \ as in (J2J), we have that (1T21) is equivalent to 

- fo^2 *3 x i + ~ f°} - 0- ~ f°)fo- (13) 

je.J+ jeJ- 

This last cut is identical to the intersection cut Indeed, if j G J + , < 
implies that max{— /()<%, (1 — /o)<%} = — foa^; and if j G J - , a^- > implies that 
max{— fociij, (1 — /o)%} = (1 — /o)oy- This ends the proof of the Theorem. □ 



Theorem [9] implies that every cut obtained from a negative basic feasible solution 
QCGLP'fcD is the simple intersection cut obtained from a tableau row of (ISLPI) . We 



now consider the strengthened cuts obtained from flCGLP'fcj ) and show that they are 
GMI cuts. 

The strengthened cuts obtained from dCGLP'^j ) are obtained by applying the 
strengthening operation defined in Section 12.11 To apply the operation, we need to 



transform our solution of flCGLP'fcD defined by (1H1)-(ITT1) to the corresponding solution 
of (CGLP). This is simply done by taking uq = {u — v) T A + 7Tq + 1, Vq — 1 — u , 
a = u T A + s — u§e k and f3 = u T b. One can easily check that if u, v is feasible for 



flGGLP'fcP , this solution is feasible for (CGLP). 



Theorem 10. Let B be the index set of a dual feasible basis of ( |SMLPfc| ) such that 
m+ k G B. Let x G IR n+m be the primal basic solution of (ISLPI) corresponding to 
basis B. Ifx m +k £ ] L^fcJ > \&k~\ [, the strengthened lift-and-project cut obtained from the 
dual solution of ( |SMLP fc [ ) corresponding to B is equivalent to the GMI cut obtained 
from basis B. 

Proof. To establish the equivalence, we need to write the strengthened lift-and- 
project cut obtained from the basis B. We recall, that the strengthening consist 
in replacing the coefficient ctj := max-ft^A 7 , v T A^} with aj for j — 1, . . . ,p, j ^ k 
where ctj is given by 

aj := mm{uA 3 — u \rrij\ , vA J + v \m.j] } 
where u,v,u and v are feasible for (CGLP) and 

uA j - vA j 



U + V 



Therefore to obtain the strengthened cut, we need to add ctj — ctj to the coefficient of 
Xj obtained in (|T3l) for j — 1, . . . ,p, j ^ k. Next, we verify that doing so one obtains 
the GMI cut ©• 

Our first order of business is to build the solution to (CGLP), we take u and v 
given by the dual solution corresponding to basis B as computed in (IB])- (jTT|) . uq is 
then given by uo = {u — v) T A + 7r + l = 7To + l — x m +k = 1 — /o (where, as before 
fo = x m+k - [x m+k \ ) and v = 1 - u = f . 



Using the definition of ( CGLP'fc ), we can rewrite mj as rrij = (tj — Sj). From 
this, it is immediate that for j G B, since Sj = tj = 0, nij = 0. Furthermore, from 



the constraints of dCGLP'^j ) we then have (u — v) T A 3 = and therefore ctj = aj. 



This implies that the coefficient of the cut is not changed for j G B. 
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We now consider j G J n N 1 . In this case, using the value of the dual solution 
given by (l8l)-(fTTT). we have rrij = (tj — Sj) = Summing up everything, so far, we 
have that the formula for a.j for j G {1, ... ,p}\B is given by 



(X; 



min{uA J - (1 - /o) faiJ , ^ + /o fail }■ 



To establish the strengthened coefficients, we consider separately the case j G J + 
and the case j £ J". 

First, assume j G J + fl TV 7 . Then < 0, Sj = — Ojj and £j = 0. From 
(i> — u) T = (sj — tj) = —Hij > 0, we have dtj = vA> and uA j = vA^ + ciy therefore: 

"i ~~ <% = min { vA3 + ®ij ~ (1 ~~ /o) fail i ^ J + /o fail } ~~ = 

min {a^- - (1 - /o) fajj , /o fail } ■ 

Since j G J + , the coefficient for £j in ( TT3]) is —fociij, the new coefficient is therefore: 

- / O oy + min {aij - (1 - /o) fajj , Jo fail } 

= min {-fodij + aij - (1 - /„) fajj , -/oBy + /o fail } 

= min {(1 - f ) (a^ - fajj ) , f ( [a,jj - %)} 

Now, we consider the case j G fl TV 7 . Then > 0, Sj = and tj = a^. From 
(w — u) T Ai = (sj — tj) = —Hij < 0, we have 6>j = uA^ and vA^ = uA^ — a^ therefore: 

"i _ <% = min { uAJ ~ (1 _ /o) fail ) ^ J - oij + /o fail } - U A ] = 

min {- (1 - /„) [a^J , -ay + f \a tj ] } . 

Since j G J - , the coefficient for Xj in (|T5|) is (1 — /ofaj, the new coefficient is 
therefore: 

(1 - f ) a,^ + min {- (1 - /„) [a^J , -3^ + /o fail } 

= min {(1 - f ) a^ - (1 - /„) fajj , (1 - / ) 5y - %• + / fail } 

= min {(1 - f ) (a tj - fajj ) , / ( fail - a 4 j)} . 

Therefore, for both j G J + fl iV 7 and j G J~ fl iV 7 we have that the coefficient for 
the strengthened cut is 

min {(1 - Jo) fai - fajj ) , f Q ( fail - %)} . (14) 

It is trivial to check that this coefficient is the same as the GMI cut coefficient. □ 
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Note that this theorem allows to complete the results of Lemma [U by adding the 
fact that the cut obtained is indeed the intersection cut or GMI cut. 

Theorems [9] and [10] can be seen as the counterparts of Theorems 4A, 4B and 5 
in [12]. Indeed, the statements are almost equivalent except that here the simpler 
normalization condition u + v o = 1 is used here whereas the normalization condition 
^2(ui + Vi) + XX S « + ^) + ""0 + ^0 = 1 was used in [12]. In [6], the theorems of [12] were 
generalized to weighted normalizations of the form ipi(ui + u$) + £j(sj + U) + uq + 
vo = ipv where ip ^ ^+ > £ £ -R+ an d £ Theorems [91 and ITUl can be seen as 
a particular case of those latter theorems (but the proofs here are simpler and more 
direct). Another important result in [12] was an algorithm to solve (CGLP) in the 
tableau of ( ISLPj) . Our results show that, with the simpler normalization uq + Vq = 1, 
a similar algorithm to solve ( ICGLP'I) is simply to solve ( MLP'fc ). We note that a 
limitation of the algorithm in [12] is that it starts from a basis of (1SLPI) that gives a 
cut. If such a basis is not available, the solution of ( MLP'fc ) can be seen as an easy 
way to find one. 



5 Optimizing over P e and approximating P e * 

We now turn back to our initial goal which is the optimization of P e and P e * . To do 
so, we follow a simple Kelley cutting plane algorithm [35] where the master problem is 
the LP relaxation of flMILPj) augmented with cuts and the cut generation procedure 



is the solution of (MLP'fc ). More precisely, at each iteration, we first solve the master 



problem and obtain a solution x*. If x* is integer feasible, we stop. Otherwise we 



solve the separation problem flMLP'fcD for a number of fractional components of x* 
which should be integer. If some of the separation problems lead to a cut (i.e. has 
negative objective value), we add those cuts to the master problem and iterate. 
Otherwise, if all ( [MLP'fcD for all k G {1, . . . ,p} such that x* k ^ Z have non-negative 
objective value, we have a proof that x* e P e . To approximate P e *, we simply 
strengthen every cut derived by the usual strengthening procedure as done in the 
proof of Theorem [101 Note that cuts are never added to flMLP'fcD in the course of 
the procedure (i.e. we stick to generating rank one cuts only). This simple algorithm 
should terminate in a finite number of iterations (since there are only a finite number 
of rank 1 cuts) but there is no complexity guarantee. Also concerning P e * there is 
no guarantee of how good is the approximation. Nevertheless, it is guaranteed that 
approximating P e * in this way will give a better bound than optimizing P e and since 
the extra computational cost is negligible, it should always be better. 

Note that this approach is similar to the one presented in [19] although it is 
presented there from a different point of view. In [TjJ], a Benders decomposition is 
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applied to a linear programming model of P e defined in a higher dimensional space. 
Applying this decomposition amounts to performing the cut generation method out- 
lined above. The main difference between the two approaches is the separation 
problem that is solved. In [19] , a (CGLP) is solved while here we solve (1MLPI) (other 
differences are the details of our algorithm that are described below). 

In order to make this algorithm somewhat efficient, one drawback has to be taken 
care of. In the course of the algorithm, it often happens that although x* k is fractional 
the solution of flMLP'^D does not lead to a cut. If at a given iteration, this happens 
for all k G {1, . . . ,p}, this gives the useful information that x* G P e (and stops the 
algorithm) but if it only happens for some fc's it only indicates that x* G P^'l^ll) but 
does not help the algorithm in progressing. After the first iteration, this phenomenon 
usually happens very frequently, and if not taken care of, a significant part of the 
computation can be spent in solving those separation problems that do not lead to 
a cut. To try to overcome it, at each iteration we solve (MLPjJ only for those k 
which led to a cut in the previous iteration. Of course, to maintain the validity 
of the algorithm, in the case when no cuts were generated, we need to test all the 
variables (we also test all the variables in the case where some tailing off is detected). 
This strategy is obviously not perfect as still some problems QMLP'fc ) will not lead 
to cuts but it greatly improves the efficiency of the procedure (more comments on 
the practical performance will be made in Section 16.11) . The pseudo-code of the 
algorithm we apply to approximate P e * is given in Algorithm [TJ 

A second aspect where we try to make our algorithm more efficient is in trying 
to make the solutions time of the problem ( MLP'fc ) as small as possible. At each 
iteration of the algorithm in Step 4, we solve a sequence of such problem for a 
number of integer constrained variables ki, . . . ,k p . As can be expected, the problem 
are solved by the simplex algorithm, and a main question is which starting basis to 
use. Note that from one problem to the next, in general, all bounds on variables 
and constraints are changed as well as the objective function. Therefore, we can 
not expect the optimal basis of (MLP'^J to be either primal or dual feasible for 
(MLP'fc i+1 ). There is one simple exception to this, if x^ = Xk i+1 , both problems 
have the same constraint system and therefore the solution of (MLP'&J is primal 
feasible for (MLP'fc i+1 ). We try to benefit from this by solving the problems QMLP'fcD 
in increasing order of the value Xk (also hoping that if x^ is close to x^ i+1 , the 
solution of (MLP'fcJ will be close to being primal feasible for (MLP'^ 1 )). Again, 
we do not claim that our strategies are the best possible but just try to follow some 
sound heuristics rules, the computation in the next section will illustrate the practical 
performance. 
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Algorithm 1 Cutting plane algorithm for P e * 



0. Initialize feasible region. 

C <- {x G R% : A'x > 6}. 

1. Initialize variables list 

K {1, . . . ,p}, reinit «— true. 

2. Master Problem 

Solve max{c /T x : x G C}. Let x be the solution. 

3. Filter variables 

J 7 <— {i G JC : — L^iJ > e}, /C ^— 0. Sort J 7 by increasing values of Xk- 

4. Separate 



For each k G J 7 solve QMLP'/J . If the solution is < — e construct 
strengthened cut a T x > (3 from its dual solution and let JC ^— if U {A;}, 
C^Cn{x:a T x>^}. 
Termination 

If AC = and reinit = true, then STOP. 
Loop 

If JC = or tailing off is detected, then go to 1, else reinit ^— false, go 
to 2. 



6 Computational results 

We now present some computational experiments aimed at assessing the interest of 
our procedures for optimizing over P e and approximating P e *. The computations 
are performed with an implementation of Algorithm [T] in C++. The code allows the 
use of two different LP solvers Clp [32] from COIN-OR [36] and IBM CPLEX. For 
efficiency reasons, the code calls each solver directly by using their respective native 
C++ and C API. All experiments are conducted on a machine equipped with Intel 
Quad Core Xeon 2.93GHz processors and 120 GiB of RAM, using only one thread 
for each run. We use Clp version 1.11 and Cplex version 12. The tolerance e in 
Algorithm [T] is set to 10~ 4 and a time limit of 1 hour is imposed. Note also that 
since the number of cuts generated can sometime grow very large, we use a cut pool 
to keep the size of the master problem reasonable. 

Our main goal in these experiment is to assess how useful a relaxation P e * can be 
and how quickly it can be computed. First, we will present computations of P e and 
P e * on a large set of problems. Next, we present several comparisons with different 
methods: 

• first, a comparison in terms of gap closed with textbook GMI cuts and lift- 
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and-project cuts generated by rounds; 

• second, a comparison with several other methods recently proposed to generate 
rank-1 cuts: the heuristics proposed by Dash and Goycoolea [25], the relax-and- 
cut framework proposed by Fischetti and Salvagnin [31], the new reduce-and- 
split proposed by Cornuejols and Nannicini [21] and finally the computations 
of the GMI/MIR closure made by Balas, Saxena [13] and Dash, Giinliik, Lodi 

• finally, some preliminary experiments on using P e * in a branch-and-cut frame- 
work. 

All experiments are performed on MIPLIB3 [15] and MIPLIB 2003 [37] problems. 

Before proceeding to the results, let us remind that computations of P e * were 
already conducted in [TO] and stress the differences with the current paper and the 
interest of the new experiments presented here. The approach in [19] used a cut 
generation LP formulated in a higher dimensional space. Although it is possible 
that each cut separated was deeper there, the size of the cut generation LPs and 
their solution time limited the applicability of the approach to small and medium 
size problems. For that reason the computational experiments in [Tj| were limited 
to problems with up to 1000 variables. We did not carry out systematic comparison 
between the two approaches but let us note that on the test set used in [19] our code 
is about 12 times faster than the results reported there (although our tolerances are 
likely to be stricter). This is certainly in part due to faster machines and faster LP 
codes but we believe also to the use of a better separation LP. One main interest of 
the experiments here is that thanks to these faster computing time we are able to 
report numbers on the complete MIPLIB 3 and MIPLIB 2003 problems. 

6.1 Computation of P e and P e * 

We ran our code to compute P e and approximate P e * on 62 MIPLIB 3.0 instance^ 
and 20 MIPLIB 2003 instances that are not already in MIPLIB 3.0. We have ran each 
instance with four variants of the code: computation of P e and approximation of P e * 
both with Clp and CPLEX as LP solver. The code is run on the original instance 
without any preprocessing. The results of these experiments are summarized in 
Tables [1] and [21 For each test problem, we report the CPU time and the fraction of 
the integrity gap closed by the method. 

: We do not report computations on marksharel, markshare2 and pkl, because our code ran 
into computational troubles on these two instances when using CPLEX as LP solver. Note however 
that no gap is closed either by P e or P e - 
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Table 1: CPU time and gap closed by P e and P e » on MIPLIB 3.0. 



Clp CPLEX Clp CPLEX 



name 


Ur U (S) 


% gap 


Ur U (S ) 


% gap 


Ur U (s ) 


% gap 


Ur U (s ) 


% gap 


lOtcams 


3600 





3600 


31.31 


3600 


100 


3600 


100 


air03 


1.24 


100 


0.36 


100 


0.86 


100 


0.39 


100 


air04 


3600 


41.34 


3600 


83.71 


3600 


53.66 


3600 


91.29 


air05 


3600 


49.98 


3600 


65.43 


3600 


57.90 


3600 


68.11 


arkiOOl 


6.01 


20.34 


15.59 


20.34 


3.42 


35.59 


4.51 


36.44 


bell3a 


0.01 


64.56 


0.02 


64.56 


0.01 


64.56 


0.01 


64.56 


bell5 


0.06 


86.25 


0.04 


86.25 


0.04 


86.55 


0.03 


86.55 


blend2 


0.11 


21.82 


0.08 


21.82 


0.08 


22.01 


0.06 


22.54 


cap6000 


3.45 


50 


0.89 


50 


1.30 


62.50 


0.25 


56.25 


dano3mip 


3600 


0.20 


3600 


0.51 


3600 


0.22 


3600 


0.52 


danoint 


3600 


4.75 


245.25 


5.57 


3600 


5.06 


213.79 


5.97 


dcmulti 


2.47 


98.15 


1.67 


98.15 


1.94 


98.76 


0.85 


98.19 


dsbmip 


3600 


no_gap 


0.60 


no_gap 


3600 


no_gap 


0.98 


no_gap 


egout 


0.05 


93.85 


0.03 


93.85 


0.04 


93.85 


0.02 


93.85 


enigma 


1.06 


no_gap 


3.92 


no_gap 


5.57 


no_gap 


0.42 


no_gap 


fast0507 


3600 


3.01 


3600 


8.58 


3600 


2.91 


3600 


11.35 


fiber 


9.35 


20.63 


2.60 


20.63 


1.41 


93.55 


0.59 


97.10 


fixnet6 


76.64 


86.36 


17.79 


86.36 


37.88 


86.53 


11.32 


87.12 


flugpl 


0.00 


11.72 


0.00 


11.72 


0.00 


11.72 


0.00 


11.72 


gen 


3.74 


70.49 


2.03 


70.49 


0.38 


82.51 


0.20 


93.99 


gesa2 


2.10 


59.10 


1.38 


59.10 


1.14 


66.06 


0.60 


67.38 


gesa2_o 


2.23 


59.80 


1.75 


59.80 


1.56 


65.20 


0.81 


72.66 


gesa3 


16.71 


79.95 


7.06 


79.95 


3.19 


94.40 


1.19 


94.59 


gesa3_o 


20.61 


82.88 


6.83 


82.88 


2.75 


94.40 


1.38 


94.40 


gt2 


0.03 


92.38 


0.02 


92.38 


0.04 


98.34 


0.02 


98.58 



25 



Table 1 (continued): CPU time and gap closed by P e and P e * on MIPLIB 3.0. 



Pe Pe" 

Clp CPLEX Clp CPLEX 



name 


CPU(s) 


% gap 


CPU(s) 


% Ear> 


CPU(s) 


% sap 


CPU(s) 


% Kan 


harp2 


29.88 


21.28 


4.65 


21.28 


7.27 


50.39 


5.02 


56.03 


khb05250 


0.52 


99.86 


0.32 


99.86 


0.29 


99.95 


0.28 


99.95 


11521av 


333.68 


34.46 


36.98 


34.46 


200.71 


61.64 


20.55 


64.53 


lseu 


0.03 


16.58 


0.02 


16.58 


0.02 


77.45 


0.01 


69.59 


mas74 


0.18 


5.47 


0.06 


5.47 


0.05 


7.95 


0.04 


8.06 


mas76 


0.26 


3.68 


0.06 


3.68 


0.05 


7.32 


0.02 


7.32 


misc03 


2.48 


40.21 


0.63 


40.21 


1.64 


40.21 


0.49 


40.21 


misc06 


0.60 


89.66 


0.29 


86.21 


0.48 


95.40 


0.21 


87.36 


misc07 


18.17 


11.44 


6.74 


11.44 


14.18 


13 


4.71 


13.31 


mitre 


914.05 


100 


131.19 


100 


6.61 


100 


3.48 


100 


mkc 


3600 


50.60 


26.72 


63.18 


3600 


62.82 


84.80 


64.03 


mod008 


0.08 


9.02 


0.03 


9.02 


0.04 


37.36 


0.02 


37.58 


modOlO 


183.37 


52.51 


17.10 


52.51 


1.86 


100 


0.11 


100 


modOll 


3600 


39.41 


3600 


53.46 


3600 


39.48 


3600 


56.24 


modglob 


0.51 


57.09 


0.30 


57.09 


0.72 


57.09 


0.47 


61.91 


noswot 


3600 





0.06 





3600 





0.08 





nw04 


3600 


35.19 


3600 


37.71 


3600 


97.62 


194.03 


100 


p0033 


0.01 


8.19 


0.01 


8.19 


0.01 


57.76 


0.01 


76.40 


p0201 


0.75 


46.85 


0.61 


46.85 


1.30 


69.75 


0.87 


71.51 


p0282 


0.50 


93.90 


0.21 


93.90 


0.47 


98.41 


0.27 


98.69 






u l.OJ 






3 1 9 


Q4 97 






p2756 


5.72 


81.59 


2.89 


81.60 


4.21 


98.90 


1.18 


96.31 


pp08a 


0.25 


79.29 


0.13 


79.29 


0.26 


79.29 


0.15 


79.29 


pp08aCUTS 


0.69 


68.81 


0.43 


68.81 


0.76 


70.17 


0.55 


69.09 


qiu 


3600 


76.20 


979.10 


78.10 


3600 


69.63 


1712.86 


78.10 


qnetl 


15.59 


94.28 


15.30 


94.28 


22.77 


94.49 


15.48 


96.27 


qnetl.o 


2.07 


87.59 


2.89 


87.59 


2.08 


89.74 


4.03 


89.78 


rentacar 


3600 


63.22 


3600 


90.28 


3600 


75.68 


3600 


98.51 


rgn 


0.18 


11.88 


0.21 


11.88 


0.12 


73.65 


0.04 


69.88 


rout 


161.12 


28.01 


18.61 


28.01 


12.63 


52.18 


2.40 


55.24 


setlch 


0.64 


39.88 


0.42 


39.88 


0.77 


39.88 


0.31 


39.88 


seymour 


3600 


3.72 


2624.25 


55.94 


3600 


4.46 


3144.46 


57.69 
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Table 1 (continued): CPU time and gap closed by P e and P e * on MIPLIB 3.0. 



Pe Pe" 

Clp CPLEX Clp CPLEX 



name 


CPU(s) 


% gap 


CPU(s) 


% gap 


CPU(s) 


% gap 


CPU(s) 


% gap 


stein27 


0.29 





0.33 





0.26 





0.48 





stein45 


8.72 





23.90 





10.67 





17.54 





swath 


48.53 


2.77 


13.00 


2.77 


22.07 


26.31 


5.52 


26.31 


vpml 


0.18 


31.42 


0.11 


31.42 


0.12 


36.07 


0.09 


33.17 


vpm2 


0.47 


54.29 


0.22 


54.29 


0.40 


54.36 


0.18 


54.41 



Table 2: CPU time and gap closed by P e and P e * for MIPLIB 2003. 

Pe Pe* 



Clp CPLEX Clp CPLEX 



name 


CPU(s) 


% gap 


CPU(s) 


% gap 


CPU(s) 


% gap 


CPU(s) 


% gap 


alclsl 


1509.64 


78 


.68 


141.93 


78. 


.75 


706.01 


78. 


.72 


154.91 


78.85 


aflow30a 


8.19 


42 


.41 


2.42 


42. 


.41 


4.72 


42. 


.61 


2.05 


43.21 


aflow40b 


69.58 


34. 


.29 


14.02 


34. 


.29 


25.37 


35 


.18 


12.11 


35.84 


atlanta-ip 


3600 


0. 


.02 


3600 


1. 


.71 


3600 


0. 


.02 


3600 


1.09 


glass4 


13.99 







1.01 







10.96 


0. 


.09 


1.82 


0.08 


momentum 1 


3600 


30 


.47 


3600 


41. 


.09 


3600 


30. 


.11 


3600 


42.80 


momentum2 


3600 


19 


.15 


3600 


41. 


.96 


3600 


11. 


.69 


203.17 


41.34 


msc98-ip 


3600 


0. 


.88 


3600 


42 


.26 


3600 


1. 


.19 


3600 


44.55 


mzzvll 


3600 


6 


.54 


3600 


51. 


.23 


3600 


10. 


.97 


3600 


98.37 


mzzv42z 


3600 


4. 


.53 


3060.04 


87. 


.74 


3600 


14. 


.66 


371.54 


100 


net 12 


3600 


5 


.71 


3600 


22. 


.78 


3600 


4. 


.70 


3600 


22.62 


nsrand-ipx 


1794.49 


36 


.88 


292.98 


36 


.88 


63.55 


75. 


.38 


28.55 


77.70 


optl217 


2.32 





.19 


0.78 


0. 


.19 


1.53 


23. 


.54 


17.67 


30.10 


protfold 


3600 


6 


.84 


3600 


10 


.29 


3600 


8. 


.34 


3600 


7.80 


rd-rplusc-21 


3600 







3600 







3600 







3600 





roll3000 


721.17 


16. 


.30 


163.90 


16. 


.30 


547.61 


54. 


.11 


139.12 


56.27 


sp97ar 


3600 


42 


.04 


570.42 


42. 


.06 


3600 


57. 


.47 


828.83 


59.94 
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Pe 




Pe* 




name 


Clp CPLEX 

CPU(s) % gap CPU(s) % gap 


Clp 

CPU(s) 


% gap 


CPLEX 

CPU(s) % gap 


timtabl 
timtab2 
trl2-30 


0.66 26.99 0.40 26.99 
1.98 20.98 1.16 20.98 
7.91 64.12 4.16 64.12 


0.61 
3.31 
6.49 


42.31 
42.69 
64.13 


0.36 42.45 
1.07 40.18 
3.33 64.12 



Several remarks can be made from these results. First the proportion of the 
integrity gap closed is significant on most instances. There are only 5 instances 
(stein27, stein45, glass4 and rd-rplusc-21) on which no gap is closed. On 
average, on MIPLIB 3.0, P e closes 47.12% of the integrity gap with Clp and 50.40% 
with CPLEX, while on MIPLIB 2003 the gap closed is 21.85 and 33.1% respec- 
tively (note that these differences are mostly due to problems which go to the time 
limit). Approximating P e * closes significantly more gap: on MIPLIB 3.0 60.15% 
and 63.42% with Clp and CPLEX respectively, on MIPLIB 2003 29.9% and 44.37%. 
The computations on P e * highlight the heuristic nature of the approximation since 
the gap closed can be significantly different depending on the LP solver used (while 
the results are usually similar for P e ). Finally, computing times vary a lot between 
instances but are usually close between the four methods. In total, for P e * with 
CPLEX (our best method) 14 problems go to the time limit (7 in MIPLIB 3.0 and 7 
in MIPLIB 2003). 7 out of these 14 can be solved to optimality in a shorter comput- 
ing time with CPLEX (lOteams , air04, air05, fast0507, rentacar, qiu and 
mzzvll), 6 would take longer than an hour (atlanta-ip, momentuml, msc98-ip, 
net 12, protf old and rd-rplus-sc2l) and one is an open problem (dano3mip). In 
spite of these instances, computing times are typically small with a geometric mean 
of 5.02 and 1.79 seconds respectively for P e * with Clp and CPLEX on MIPLIB 3.0, 
and 233 and 119 seconds respectively on MIPLIB 2003. Note that computing times 
are often slightly higher for P e . This is not surprising since our stopping criterion is 
that the point x* belongs to P e and that the cuts generated in P e * are always deeper. 

In table [21 we give geometrical means for a number of key statistics of our pro- 
cedure: the number of master iterations of the procedure (i.e. the number of times 
step 2 of Algorithm [1] is performed), the CPU time spent to solve the master problem 
(i.e. the total time spent in step 2), the total number of time a separation problem 
QMLP'fc ) was solved, the number of times it led to a cut, the number of times it did 
not lead to a cut, the CPU time spent to solve separation problems, and finally the 
total number of simplex iterations for solving separation problems. Statistics refer 
to the runs approximating P e * with CPLEX as LP solver. Averages figures are given 
on three sets of problems: all instances of MIPLIB 3.0, all instances in MIPLIB 3.0 
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that took more than 1 second of CPU time and all instances solved within the time 
limit. 



MIPLIB 3 > Is. CPU finished 



# Master iterations 
total resolve time 



# QMLP'fcD solved 

# cuts 

# non-cut 



total (IMLP'fcD time 



total (MLFj.) pivots 



56.6 


141.3 


47.3 


0.4 


17.43 


0.14 


563.4 


2844.5 


433.10 


514 


2749 


335.7 


49.4 


95.5 


97.4 


0.5 


14.21 


0.21 


7,624 


140,599 


3,781 



Table 3: Detailed statistics of P e * approximation on MIPLIB3 problems. 



The main observation we can make from table [3] is that the time to solve ( MLP'fc ) 
is usually very small: on average it takes 8.910 -4 seconds to solve if we consider the 
whole of MIPLIB 3.0, 5.010" 3 seconds if we restrict to problem that took more than 
1 second of CPU time. This can be explained by the number of pivots which is also 
small with about 13 pivots on average on MIPLIB 3.0 (49 if we restrict to problems 
that took more that 1 sec). This is also illustrated by the fact that in total re- 
solving the LP relaxations after adding cuts takes about the same time as solving 
( MLP'fc )'s. Another interesting figure is the proportion of separation problems that 
led to a cut. Here one should only look at the statistics for problems that are finished 
(other statistics are biased by unfinished problems where the proportion of cuts is 
typically much higher), on average 22 % of flMLPys did not lead to a cut. 



6.2 Comparison with GMI and lift-and-project cuts 

We now turn to the comparison with GMI and lift-and-project cuts. To perform 
this comparison, we use a standard implementation of a GMI cuts (following [9]) 
generator that we developed using COIN-OR and the publicly available code for 
generating lift-and-project cuts CglLandP [HJE]. We run both codes with different 
number of rounds. First we compare the gaps closed after one round of cuts. The 
goal of this is to compare the gap closed by rank-1 cuts using P e and P e * with the gap 
closed by the rank-1 cuts generated by more classical methods. Second, we compare 
the gaps closed after 10 rounds of cuts. This is a reasonable setting for cut generators 
in a branch and-cut procedure. Finally, we compare the gaps closed after 100 and 
50 rounds of cuts for GMI and lift-and-project respectively. Since the computing 
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time for P e * are rather high compared to 10 rounds, this last setting is to see if when 
given a large number of rounds GMI and lift-and-project cuts can approach P e *. 
Of course, as more round are performed, the rank of the GMI and lift-and-project 
cuts increases (Fischetti, Lodi and Tramontani have experimented that it typically 
increases faster with GMI cuts [29]). Since both codes for GMI and lift-and-project 
cuts work only with Clp, we compare with our runs using the same solver. In Table 
HI we report geometrical means of the computing times and averages of gap closed 
for each method on MIPLIB 3.0. 





time (sec.) % , 


gap closed 


Pe 


8.08 


47.12 


Pe* 


5.02 


60.15 


1 GMI round 


0.00 


25.74 


10 GMI rounds 


0.04 


44.39 


100 GMI rounds 


0.45 


49.80 


1 1-a-p round 


0.04 


26.38 


10 1-a-p rounds 


1.63 


52.88 


50 1-a-p rounds 


9.36 


57.62 



Table 4: Comparison between P e and P e * with GMI cuts and lift-and-project cuts 
generated by rounds. Geometrical means of CPU times and average gap closed. 

Several remarks are in order. First, comparing rank-1 cuts only, we note that 
the gap closed with P e and P e * is considerably bigger than the one closed by either 
GMI or lift-and-project cuts. Of course, this requires a much higher computing time. 
Iterating GMI and lift-and-project cuts, the gap closed never reaches the one closed 
by P e *. After 100 rounds of GMI it is only slightly higher than the gap closed by P e . 
The gap closed by lift-and-project cuts after 10 and 50 rounds is significantly bigger 
than with GMI cuts and with P e but it is still smaller than with P e * , while the CPU 
time becomes bigger for 50 rounds. Due to the tailing off effect encountered when 
generating GMI and lift-and-project cut by rounds, it is likely that GMI generated 
in this fashion will never reach the gap closed by P e * and lift-and-project cut would 
probably have much difficulties. 

6.3 Comparison with other methods based on rank-1 cuts 

To finish our comparisons of gaps closed, we compare our results with several recent 
related works that also aim at separating rank 1 cuts. First, we make a comparison 
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with the computations of the split (or equivalently MIR) closure performed by Balas 
and Saxena p3] and Dash, Giinliik and Lodi [26]. The split closure is a tighter 
relaxation than ours, but the computing times are usually very high (hours). It is 
therefore interesting to know how close we are able to approach those results with our 
comparatively fast procedure. Secondly, we make a comparison with two methods 
that are also aimed at generating rank-1 GMI cuts from basic tableau's. The first 
of these was proposed by Dash and Goycoolea [25] and consists of several heuristics 
for finding violated rank-1 GMI cuts. The second of these is a framework based on 
generating GMI cuts and relaxing them in a Lagrangian fashion proposed by Fischetti 
and Salvagnin [31]. Finally, we make a comparison with another recent work by 
Cornuejols and Nannicini [2.4] that aims at generating more rank-1 split cuts by a 
reduce-and-split approach. The test instances we consider are a subset of MIPLIB 
3.0 and the MIPLIB 2003 that were used in [251 I3T] (split closure computations are 
only available for MIPLIB 3.0). 

In Table we report the average gap closed by the split closure (for each prob- 
lem we took the strongest value from [13] and [26]), Dash and Goycoolea method, 
Fischetti and Salvagnin method, and our method for P e *. Both [23] and [3T] have 
proposed several variants of their methods, to make the comparison concise we se- 
lected only one for each approach: the default approach of Dash and Goycoolea 
and the fast approach of Fischetti and Salvagnin. We also report indication of com- 
puting times. Note that these times should be considered with much care because 
experiments have been performed on different machines with different CPUs and dif- 
ferent LP solvers. The computing times in [25] refer to a 1.4 GHz PowerPC machine 
for MIPLIB3.0 and to a 4.2 PowerPC machine for MIPLIB 2003. The computing 
times in [31], refer to a 2.4GHz Intel Q6600. As can be seen from the table, the 
split closure is significantly stronger than any of the three methods using GMI cuts 
from tableau's closing 79.2% of the gap on MIPLIB 3.0 versus between 59.6% and 
64.9% for the three GMI methods. This can be seen as relatively far, but given the 
significantly shorter computing times of all three methods, it can also be seen as a 
fairly good approximation (note that on 9 instances our approach closes more gap 
than [13] and [26]). Comparing the three GMI methods, our approximation of P e * 
closes the most gap on MIPLIB 3.0 and [31] closes the most gap on MIPLIB 2003. 
The computing times of [31] and ours are close ([31] is slightly slower on MIPLIB 3, 
but quite faster on MIPLIB 2003), while [25] seems to be somewhat slower (note that 
besides the different CPUs, the three methods have different termination criterion). 
An important element not conveyed by average figures is that none of the three GMI 
methods dominates the other two: each closes the most gap on some instances. On 
MIPLIB 3.0, P e * closes more gap than the other two for 16 instances, [3T] closes 
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more gap for 10 and [25] closes more gap for 14. On MIPLIB 2003, P e * closes more 
gap for 7 instances, [3T] for 8 and [22] for 4. Another method to compute split 



method 




MIPLIB 3.0 


MIPLIB 2003 






time 1 


% gap 


time 1 


% gap 


Split closure (best from pj 


a [26]) 


7556 


79.2 






Heuristic rank-1 GMI cuts 


[25] 


20.05 


61.6 


854 


39.7 


Relax and GMI cuts [31] ( 


fast) 


2.25 


59.6 


58.4 


45.4 


P e * approximation 




1.36 


64.4 


119 


44.4 



Table 5: Comparison of methods for rank-1 GMI cuts from tableau's 



cuts that differs from traditional GMI cuts from the tableau is the reduce-and-split 
method pQ. The method was recently re-explored and enhanced by Cornuejols and 
Nannicini [21]. In Table [6j we compare the gap closed by our method to the gap 
closed in [21] and the Split Closure. The test set consists only of the Mixed models 
in MIPLIB 3.0 since reduce-and-split is particularly aimed at those. The gap closed 
reported in [24J correspond to the gap closed by one round of several cut generators 
for in the Cgl library (GMI cuts, MIR cuts, lift-and-project, two-step MIR, cover, 
flow covers) plus several variants of the reduce-and-split cuts. On these instances 
our method closes more gap on average than the combination of rank-1 cuts in [24j. 
Again it is important to note that our method does not dominate [21] and we close 
less gap on 9 instances. 



method 




% gap 


Split closure 




78.64 






60.77 


Reduce and split + CglCuts 


[24J 


50.33 



Table 6: Comparison with reduce and split cuts on mixed models in MIPLIB 3.0. 

To conclude this section, we emphasis that all the rank-1 methods compared 
here complement each others. As noted several times, no method is dominating the 
others. Combining the four methods, even in a trivial way, should give a better 
approximation of the split closure. 

1 timings on different machines 
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6.4 Branch-and-cut computations 

The experiments reported in the last three subsections show that our approach based 
on P e * seems competitive for building a strong relaxations at least for MIPLIB prob- 
lems. Of course, our ultimate goal is to be able to solve those problems faster. 
Applying our method in a branch-and-cut setting is not straightforward. First, the 
computing times, although small on average, are certainly higher than any of the 
cutting plane techniques already available in solvers. It can sometime be even larger 
than the total CPU time taken by a state-of-the-art solver such as CPLEX. Second, 
state-of-the art solvers combine many different cut generators and we need to include 
our method in the cut generation loop. Finally, although the gap closed is intuitively 
a good measure of the quality of a relaxation, many different factors can influence 
the performance in a branch-and-cut. Here, we present a preliminary attempt to 
deal with those issues and use P e * in a branch-and-cut setting. 

To setup the experiment, we use the callback system of CPLEX in order to include 
our procedure in its branch-and-cut loop. Note that our procedure can be included in 
two ways. Since the outer loop of our procedure is similar to a classical cut generation 
loop, we could try to include our procedure by just adding the inner loop (steps 3 and 
4 of Algorithm [Tj) as a cut callback. This would have nevertheless the disadvantage 
that we would loose some control on the termination of the procedure. Therefore, 
we follow the more simple approach to run the complete procedure described by 
Algorithm [T] (i.e. except for the context in which it is used it is the same procedure 
as before). 

We call our procedure only once at the root node. Since, CPLEX has its own 
cutting plane procedures which are usually faster than ours, we should try as much 
as possible to benefit from them. In particular, even though we don't use the cuts 
generated by CPLEX in our separation LP, our procedure can benefit from CPLEX 
cutting planes because the point to cut should be closer to P e * after several rounds 
of cutting planes. For this reason, we try to call our procedure at the end of CPLEX 
cut generation loop. Since, as far as we know, there is no direct way of knowing 
if CPLEX has decided that it has exhausted its own cut generators, we attempt to 
detect it as follows: each time CPLEX calls our callback, we record the number of 
cuts generated for each class of cuts that CPLEX has, if from one iteration to the 
next none of those number changed, we launch our cutting plane procedure. At the 
end of the procedure, we pass to CPLEX all the cuts we found that are binding at 
the current optimum. 

Note that many decisions that could impact the efficiency of our procedure in a 
branch-and-cut can be made. For example, cut generation procedures usually have 
policies to reject cuts that are too dense or deemed numerically unstable. Also, 
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our termination criterion and the tolerances we use may be too tight for practical 
purposes. In this preliminary experiment, we do not intend to settle these issues. 
First, we want to keep the results in line with those of the previous sections. Second 
we believe that those issues can be addressed in different ways and should be the 
subject of further research. Our goal is just to give a preliminary view of how a 
procedure such as ours could be used, and what issues should be dealt with. 

To test our procedure, we run it on the same set of MIPLIB 3.0 and MIPLIB 2003 
problems that we used in Section lfT3l We run two settings. First, the default CPLEX 
branch-and-cut algorithm (we don't use dynamic search since it is disabled when a 
cut callback is used in CPLEX) denoted CPLEX-BAC. Second, CPLEX augmented 
with our cut callback denoted CPLEX+P e . . Note that, we apply our method to the 
preprocessed model of CPLEX. In both settings, we set a global time limit of 3 
hours of CPU time (CPLEX is run on 1 thread). To report the results, we group 
the instances in three sets: set A consists of 37 instances that are solved with both 
CPLEX-BAC and CPLEX+P e * in less than 10 seconds, set B contains 16 instances that 
are not in set A but are solved by all our setups, finally set C are 8 instances that 
could not be solved by any setup. Two instances do not belong to any of these sets 
and are reported separately: danonint is solved by CPLEX-BAC but not by CPLEX+P e * , 
nsrand-ipx is solved by CPLEX+P e » but not by CPLEX-BAC. For CPLEX+P e *, we test 
two time limits for the P e * procedure a short time limit of 10 seconds (denoted 
CPLEX+P e *-10), and a long one of 1800 seconds (denoted CPLEX+P e .-1800). 

We report the results in Table [7J For each set of instances, we report the average 
gap closed at the root, the geometrical means of CPU time and number of nodes 
processed and the average final gaps. 

The result shows that we are still able to generate violated rank-1 cuts after 
CPLEX has generated all its cuts. Our methods allows to close 12.7% more gap at 
the root for instances in set A, 13.6% for instances in set B with a time limit of 10 
seconds and 25.4% with a time limit of 1800 seconds. For instances in set C, the 
difference is less significant: 1.5% and 5.5% with a time limit of 10 and 1800 seconds 
respectively. Unfortunately, the improvement in terms of gap closed at the root does 
not carry out in terms of total solution times. For instances in set A the CPU time 
is more than 3 times bigger and for instances in set B it is around two time bigger 
with CPLEX+P e »-10 and 5 times bigger for CPLEX+P e »-1800. For instances in set C, 
the gap closed after 3 hours is on average smaller with CPLEX+P e *-10. The results 
in terms of number of nodes are not as grim. The node reduction is limited with 
CPLEX+P e .-10, but with CPLEX+P e »-1800 we are able to divided the total number 
of nodes by 2 on set B . 
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method 




root % gap time 


# nodes 


final gap 


Instances in set A 


CPLEX-BAC 




73.2 0.12 


69.55 





CPLEX+P e » 




85.9 0.39 


41.04 





Instances in set B 


CPLEX-BAC 




32.4 46.64 


11723 





CPLEX+P e *- 


-10 


46.0 93.85 


10414 





CPLEX+P e *- 


-1800 


58.8 238.15 


5461.31 





danoint 


CPLEX-BAC 




2.92 7993 


1119303 





CPLEX+P e »- 


-10 


3.68 > 10800 


> 585297 


44.9 


CPLEX+P e »- 


-1800 


5.8 > 10800 


> 188971 


32.6 


nsrand-ipx 


CPLEX-BAC 




50.03 > 10800 


>849402 


84 


CPLEX+P e »- 


-10 


76.8 3449 


220105 





CPLEX+P e » 


-1800 


79.8 892.74 


52780 





Instances in set C 


CPLEX-BAC 




23.2 > 10800 


> 31339 


45.5 


CPLEX+P e * 


-10 


24.7 > 10800 


> 19066 


42.7 


CPLEX+P e »- 


-1800 


28.7 > 10800 


> 4383 


42.5 



Table 7: Summary of results with branch- and- cut. 
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7 Conclusions 



In this paper we proposed a procedure to approximate P e *. Our approach seems 
competitive at least for strengthening the initial formulation and closing integrity 
gap and is also relatively fast compared to previous similar approaches. These results 
are another illustration of the strength of low rank cuts. The competitive CPU times 
are largely due to the separation procedure we use. As our experiment show, we are 
usually able to generate violated rank-1 cuts very quickly. 

A possible source of improvement for the procedure in terms of CPU time, would 
be to use the separation oracle in a framework that would have better convergence 
properties than the Kelley cutting plane method. It is well known that the Kelley 
method has slow convergence. Recently, Fischetti and Salvagnin proposed an in-out 
scheme for optimizing P e which bears many similarities with our approach [30] . The 
computational results they report do not seem competitive to ours in terms of CPU 
time but they are able to reduce significantly the number of iterations compared to a 
Kelley approach. These results g ive hope that the CPU times to compute P e could 
still be significantly reduced (note however that adapting their approach does not 
seem trivial to us). 

Another source of improvement would be to use the Balas Perregaard algorithm 
to strengthen the cut obtained by solving flMLPj) . From a theoretical point of view, 
this is a straightforward thing to do. One just need to give the optimal basis of 
( 1MLPI) as a starting point of the Balas Perregaard algorithm. Unfortunately, it is 
much more involved in practice, in particular if one want to keep the separation 
efficient in terms of CPU time. 

Finally, we would like to emphasize the interest of finding an exact procedure to 
optimize P e * . From the combination of our computational results and those contained 
in [251 EH], we can try to get a feeling of how far our respective approximations of 
P e * are from being optimal. On the MIPLIB 3.0 test set, our respective average 
strengthening are 64.4%, 61.6% and 59.6% of the integrity gap closed. If we combine 
the three methods by taking the best result of the three methods on each instance the 
average goes up to 70.9%. This certainly shows that the three methods are still far 
from the value of P e * . Note that even if we add up the computing times of the three 
procedures, the average CPU time is still a small fraction of the time to compute 
the split closure which closes 79.2% of the integrity gap. As stated in introduction, 
as far as we know, the complexity of optimizing P e * is open. These numbers give a 
computational motivation for attempting to settle the question. 
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